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CHAPTER 1 
Introduction 



This thesis presents the detailed design specifications 
for a mechanism to handle absentee (or background) computations 
In a multiple-access computer system. The mechanism operates 
as a package of self-contained modules with a minimum of 
dependencies upon the environment in which it resides. Thus, 
it may be inserted into any existing multiple-access computer 
system which has the proper environmental features, 

The work of this thesis is concentrated in several areas. 
First, those features which are desirable in a system for 
handling absentee computations are considered. Many of these 
features exist in current working systems, but several new 
features are proposed. 

Second, the overall design for a new type of absentee 
mechanism is considered. The functions of each module in the 
mechanism are discussed, and Interfaces between this mechanism 
and other parts of the multiple-access computer system are 
defined. 

Next, the detailed design is presented for the two major 
portions of the new absentee handling mechanism. This design 
is Interesting for several reasons i 
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1 - Absentee computations are supported in a system 

designed for time-sharing applications. 

2 - The amount of absentee usage on the system may 

be carefully regulated to comprise anywhere from 
0% to lOOJf of the total absentee and interactive 
system usage. 

3 - The portion of system usage assigned to absentee 

computations may be further subdivided and assigned 
to absentee computations of various "types". This 
provides for ease in implementation of priority 
schemes for determining which computations should 
currently be serviced by the system. 
k - The apportionment of system usage Is made flexible 
by the absentee handling mechanism to prevent waste 
of available computing capability. 

5 - Computations of a particular "type" are always 

guaranteed first claim to the portion of system 
usage assigned to them. 

6 - The mechanism may temporarily suspend and then 

automatically resume an absentee computation thus 
making Such Interruption transparent to the computation. 



la 



'fm^g^^^^~>;^M-f-'fS^^^^7^^s i Vii0^^!^! 



1 ^■^-^-^.^.S^-AC^X'^f^ 



This ability Is useful 1» providing the 
apportionment flexibility mentioned above. 
Finally, an attempt Is mad* to specify a compact 
set of coaaands for users and adalnistratlTe personnel. 
The Coaaands 'are designed to pre^y^s smooth Interaction 
with the facilities and capabilities of the proposed 
absentee handling aeohanism* In particular* coaaands 
are provided to perf era certain obvious functions such 
as creating and terminating absentee computations, and 
certain functions unique to this application such as 
converting an Interactive computation to abeentee and vice 
versa, and specifying the Apportionment of system usage 
between Interactive and absentee computations. 



A Uffit-ffftfTliTfi compwfcar system rapidly shares Its 
resources among many users to give each user the illusion 
that his computation is constantly running. An |ij^afao^ve 
user controls the operation of his computation by issuing 
""iWft 1 "^! (usually in the form of statements typed at a remote 
teletype terminal ) to the system, observing the system's 
response to each command, and issuing further commands based 
on previous responses. An absentee user does not have to be 
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present at a terminal to control his oomputationi 
he submits a f 11a of command* ahleh specify the operation 
of his Job. The system enqueues ( I.e. » maintains an ordered 
list of) each of these deaoriptor files as they arrive. 

The oonoept of a computer utUrltr is that at- 
providing accessible computing capability ■*» a large number 
of users (referred to as the usey ' o cmannfrftr > en a twenty* 
four*feour»per~day, seven-day-perwweek heals. It 3» name! 
to expect, however, that aalfunetlona "may require that the 
systea undergo aft oecaaalonal shutdoan so that the malfunction 
nay he repaired* To resume normal operation, the system 
undergoes a startup procedure. 

Bach user of the systea nay store information In 
private fjj.es. (usually space on seeondary storage aedla 
reserved for this user). A potential user of filed 
inforaatlon Bust identify himself to the system ISp typing 
a secret Batff|f|r^ thus preventing an a u t hor lsad parsons 
from using the system. This identification procedure is 
referred to as leasing in . Whan -a user Is finished using 
the aystea he laaa out to inf or* the systea that he no 
longer needs its resources. 



■.^v^&^^^K^A^K 



^iM^^^^^l^^l^g^^^^^p^^m^^y^-T^hTf 



Unless otherwise specified, files are Used to supply 
input to and reoel-re output from absentee computations 
sinoe such computations are generally not attached to 
terminals. However, the user may desire to receive input 
to his absentee computation from a private magnetic tape 
in which oase his computation may run only If a tape drive 
is available. The tape drive in this example is referred 
to as a dedicated resouroe since it must be specifically 
assigned to this user for the duration of his computation. 
To assure that a required dedicated resource is available 
when it is needed, the user places a reaeyffftfton ■ t via the 
system) to use the resource during a specific /time period. 

Hon- time-sharing computers generally handle Jobs in 
a batch processing foxp ati the jobs are submitted in the form 
of card decks or magnetic tapes at a central computer 
installation and are processed sequentially, either one 
at a time , or in the oase of recent multi-processing systems , 
several at a time. 

7ne ffTf *-ffff Ultfl an a timet-sharlng computer system 
which services both interactive and absentee computations 
refers to the current demands for service to aM computations 
on the system. When the load deoreases more computations 
may be initiated to push the load back up to peak efficiency 
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operating levels. At any Instant during 
the operation of the system, requests for service are 
enqueued on a priority basis ( schedu^ea ) . and the request 
at the head of the queues is the first to be serviced. 
Priorities are generally assigned to computations 
to Indicate some sort of preferential ordering for service. 
^I ^ ff gii pj ft priorities are used by the system to determine 
which of several computations attempting to log in should 
actually be allowed to log in to the system. Scheduling 
Priorities are used by the system to determine which 
of several logged in computations should be given service 
by a processor when that processor becomes available. 
Admission priorities are generally fixed whereas scheduling 
priorities are dynamically computed at execution time. 



The concept of providing absentee usage facilities 
in a tine-sharing environment is not new, but the general 
design principles have not yet been discussed. Two of 
the earliest successful attempts in this area aret 
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1 - The Compatible Time-Sharing System (1,15 ) 

implemented on the IM 709** by H.I.T* in 1962, 
Absentee capabilities were included in the 
original design of C.T.S.S. The ability for 
an interactive user to Initiate an absentee 
computation was added in 196 5-4966. 

2 - Time Sharing System/360 (4,5) Implemented by 

IBM on its 360/6?. Absentee capabilities 
were included in the original design for which 
a prototype implementation became available 
in 1967. Some notable features of the TSS/36O 
Implementation Include the ability for 
a user to Interrupt his running interactive 
computation and convert it to absentee, and 
the ability for a user to Initiate a wide range 
of bulk input/output operations via commands 
which may be issued by interactive or absentee 
computations. These bulk Input/output requests are 
handled as standard absentee computations and 
are enqueued until the input/output devices 
needed to service the requests become available. 
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The absentee handling mechanism: designed in Oils thesis 
is being implemented as an Integral part of the "Multlcs" 
system ( Multip lexed Information and Coaputlng gervlce) under 
development at Project MAC at the Massachusetts Institute 
of Technology. Multlcs Is being designed and Implemented 
as a general purpose time-sharing operating system for the 
computer utility. The reader interested In exploring Multlcs 
further should consult a group of papers (5 »^ .7.8,9 ♦ JO) 
which were presented at the Fall Joint Computer Conference 
In 1965. Project MAC Technical Report^ W contains a 
discussion of the organization of the computer utility 
and a description of the basic design of the Multlcs system. 
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Chapter 2 discusses those features which are desirable 
in a system which supports absentee computations, and the controls 
that users and system administrative personnel should have 
over absentee computations. 

Chapter 3 presents a block-diagram overview of the 
absentee handling mechanism, and discusses tile functions 
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performed by eaoh of the modules In the mechanism. 

Chapter k develops the concept of a computation stream 
and then illustrates how several suoh streams may be combined 
to form a versatile multiple-stream queueing mechanism for 
absentee computations. 

Chapter 5 oonsiders the problems of regulating the 
system load in a system which supports both interactive 
and absentee computations. A mechanism for performing the 
load control function is proposed which utilizes the 
flexibility of absentee computations to assure that the 
load remains olose to its most efficient operating level. 
The mechanism allows the computing capability of the system 
to be allocated in any proportion between interactive 
and absentee computations, and provides the ability to 
quickly and smoothly adjust the system to a new load 
reappor ti onment . 

Chapter 6 presents a set of commands for users and 
administrative personnel to create, control, and terminate 
absentee computations. 
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CHAPTER 2 
Features of Absentee Computations 



This chapter defines absentee, interactive, and batch 
computations, and discusses the similarities between absentee 
and batch ooaputations, the features of absentee oonptttations, and 
the facilities of the absentee handling meehanisn* 



A user may run his computation in either of two nodes, 
namely Urtoraottje or abjfjgec.. 

An IrtiraoUTf PMHHfrttfln Uff) is controlled by a user 
who enters commands at a remote terminal, receives responses 
from the system at that terminal, and enters additional commands 
based on previous responses. The interactive node affords the 
user precise control over his computation and allows the user to 
make major changes of strategy at run time, the interactive 
mode is particularly useful for program debugging and for 
Implementing programs whioh "talk" with non-programmer users 
(administrators, scientists, flight reservation personnel, etc.) 
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An abeantec amputation (ACY does not require interaction 
with the uaer. n» user submits an absentee computation as 
a fila of commands (absentee s ource ffcteV basloelly Identical 
to the commands the uaer would enter if naming the same 
computation interactively. The abaantae aode frees the user 
from having to ba present to control hia computation and 
Is particularly useful for running ohaokad-out programs and 
"production" runs. 

A tafech; oomnutatlon is basically ldentleal to an absentee 
computation except for the Banner In which the file of 
is submitted to the system, An absentee source file is 
generally aubnittad via a remote terminal, whereas a batch 
computation command file Is generally submitted in the form 
of a card deck at the central oonputer installation. 



2. Z Features of Ab—nt— ComnutetJotMi 

An absentee computation nay ba initiated for a user by one of 
the user's interactlTe computations, another of the near' a 
absentee computations, or a, l*tokroa*«htaslan sJftSmtteftt* the user. 

A uaer*s absentee eb*patat ion* nay be terminated by any iof 
that user's InteractlTe or abaentee computations. 

A uaer may specify (for his own protection) any running time 
limit for each of his AC'S. If the time llnlt is exceeded, the 
system automatically saves the AC so that partial results are not loet. 
If the user does not specify a tine limit for an AC, then a default 
value is assumed by the system, again for the user's protection. 



A computation (IC or AC) of * particular user .may obtain 
status intonation about any of that user's computations (both 
IC's and AC*s). Detailed information about eaeit of a user's 
AC*s is always available to that user, regardices of whether 
his AC** are waiting to be rest or are currently running* 

An interactive user nay interrupt his IC at any point and 
convert it to an AC. This feature ie desirable In the ease 
that a user wishes to start his program interactively to make 
sure that It is working properly, and than oovrert the program 
to absentee so that it nay eontinue t# oonpletioa without the 
user's attention. 

An interactive user nay interrupt any one of his AC*s at 
any point and eonvert it to his current IC. This feature is 
useful in the oase that the user wants to monitor the progress 
made by his absentee computation, or perhaps wake sons run* tine 
changes in either the prograa or its data. In sons eases, the 
user say convert a computation from- a b se ntee to interactive to 
get a higher priority for the eonputatlon aoo that the computation 
nay be completed sooner. 

The system administratlTe personnel may terminate any AC 
(or IC) whiah appears to be a • troublemaker* « 

The system administrative personnel may specify an 
apportionment of system resources between «C*s and IC*s 
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1b order to eaphaslee • particular nod* during certain periods 
of systea operation. In effect, this apportlonaent partitions 
the systea into two distinct sab-systeas, on* for running AC's 
end on* for running xc*«. The AC-IC apportl ouaont aay range 
anywhere froa OJf-100? to lOOjt-Ojf. 

A «nr aay have aany running AC»s (and aany IC»s) at one 
tlae, but the number oan be administratively Halted. In the case 
that a single user has several IC*s at various terminals, each of 
the IC's has equal control over any of the user's AC»c. 

Input to an AC is aoraally taken froa *ho appropriate 
absentee souroe file. Output froa an AC aoraally goes to a 
user-spseif led ffrffflttf 711*"** flic. The user aay alternatively 
specify dedicated resources (la piece ef fires) *or «e*ta*u*/output. 

A user requiring dedicated resources for use by any of his 
AG's should place an advance reserratlon for the resources. 



2.8 Srstea Factor*. 

The systea enqueues user requests to initiate new AC's 
so that these AC'» aay be initiated la the future at a tlae 
which the systea feels is oppo rtun e. 

The systea aay teaporarlly suspend service to a naaber of 
AC»s so that an increased load of XC*s aay be acre affectively 
servioed. Similarly, the systea aay " buau " a nuabsr of IC's 
so that an Increased load of AC* s aay be serrtoed. Bdaping an IC 
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involves saving the IC ih Its ourrent state and automatically 
logging out the user. To continue a bumped IC the user wit 
log in again and specify that the bumped IC he resumed. After 
a user has been bumped, he will often find that he cannot log in 
again immediately. This oeeurs beeaase the aoet frequent 
reason for buaplng a user is to decrease the system load and 
maintain the lead at Its lower level. 

The system nay autoaatloally resuae service to suspended 
AC'S when the IC load decreases. (Hote the, asyane try here. A 
suspended AC is always automatically resumed by the system 
while a bumped IC can only be resumed by the interactive user 
himself. This property Is critical to the process of dynamic 
load balancing discussed in Chapter 5*1 

Jobs may be submitted to the system in a batch-processing 
format as a deck of card*. Such Jobs, after undargoimg a 
procedure to validate the Identity of their originators, are 
handled by the absentee mechanism in the same manner as AG's 
requested by IC's or other AC'S. 

The system makes shutdown transparent to AC'S by suspending 
any AG's running at shutdown and automatically reauming the 
suspended AC'S at startup tiae. Any AC'S which arm sitting in 
the* queues waiting to be run ..at ehutdown, remain enqueued during 
shutdown and may be initiated by the system after startup. 
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The apportionment of resources between AC's and IC*s Is 
normally done for various long period* of system operation 
called shifts . However, the demands made by AG's and IC*s 
upon the system over the short term may vary significantly 
and frequently. The system cetera to short term variations 
in demand by malting modifications to the resource apportionment 
over short periods called integration period.. The Load 
Control mechanism (see Chapter 5) compares the ourrent demands 
upon the syetea with the current shift's resource apportionment, 
and makes necessary adjustments in the AC and IC loads to insure 
that good quality servlee is provided to all running computations 
regardless of any short-term surges in demand. For example, If 
the AC-IC apportionment is 25Jt-75* and the AC demands decrease 
to only 20%, then Load Control allows enough new IC»s to be 
Initiated to bring the XC usage up to Q&Jt . tfhen the short-term 
variations are of greater magnitude, Load Control may elect 
not to match a decrease in one mode of usage with an equal 
increase in the other. Instead, It may match a 20* decrease with 
only a 10* increase. This provides a damping effect whioh helps 
to prevent the ourrent usage of system resources from varying too 
significantly from the desired shift resource apportionment. 
See chapter 5 for a more precise discussion of the load 
balancing operations performed by Load Control. 
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The system keeps track of ell ACAs: requiring dedicated 
resources to be initiated. Whenever * reservation made for 
a particular AC becomes due, the system etttomatloeliy initiates 
that AC 

In a system in which many coaputatlons are simulteaeously 
competing for serrtoe, it is desirable to provide eoae sort of 
priority mechanism to allow a user to express the relative 
iaportenee of his computation. The user is provided with a 
choioe of ttriorltT streams in which he mar request his AC be run. 
High priority streams provide serrtoe at higher eomt, :while 
low priority streams may provide slower service but at reduced cost. 
If the user does not specify in whloh priority stream he wants 
his computation to run, the system automatically inserts the 
— r .»- «-«-. ■<■—,«, *w- ffrtaflaji* ptr.— Since absentee 
computations do not necessarily have to be initiated immediately, 
a series of waiting queues is provided, one for each priority 
stream, when Load Control decides that mere absentee oomputat ions 
may run In a particular stream, it informs the mechanism which 
handles ths absentee queues to initiate en appropriate number 
of absentee computations from the waiting queue for that stream. 
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CHAPTER 3 
Overview of the Absentee Monitor 



The Absentee Monitor consists of a group of related nodules 
and a series of queues which together are responsible f Or the 
enqueueing, initiation* control, and termination of absentee 
computations. This chapter discusses the major sections of the 
Absentee Monitor and the Interrelationship between the Absentee 
Monitor and other parts of the multiple-access computer system. 
Figure 3.1 illustrates the structure of the overall mechanise 
for handling absentee computations. Chapters k, 5, 6, end 7 
describe the parts of the mechanism in greater detail. 



3.1 Maior 8eotlcns of the Absentee Monitor 

The Absentee Monitor consists of three modules end two 
sets of queues, one queue in each set being assigned to service 
each priority stream. Chapter k discusses the queueing mechanism 
In detail. 

3.1.1 Absentee Queue Control 

As new requests to initiate absentee computations are 
entered bjr users into the system,: the names of the corresponding 
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absentee source files and absentee output files (and other 
additional useful Information) are placed Into queues where 
they remain until suoh tine as the system decides to Initiate 
additional absentee computations. ■ f|^jf|)t^ ^fff , Goa^T ?j|- ■ la the 
system nodule responsible for making: appropriate entries in the 
queues, retrieving entries when they are needed by other parts 
of the absentee mechanism, and deleting entries which are no 
longer needed. 

3.1.2 Absentee Mel tine oc»n», 

*"• ***** at — Melting Queues are a series of queues, one 
p#r priority stream, whloh contain the per computation information 
for absentee computations waiting to be Initiated. A •user 
request to initiate a new absentee ooaputetion causes Absentee 
Queue Control to make an entry for this computation in the 
appropriate Absentee Waiting Queue, 

TOic Abeentee --fcaaffffrffff-fifuoj «r« m .series , of qnauea* ..one 
per priority stresm, which contain the par aoaputation information 
for each running absentee computation, sham an sbsinfrM eoaputatlon 
is initiated, Absentee Queue Control delete* the eorreaponding 
entry from the appropriate Absentee Halting Queue, and Inserts 
an entry in the appropriate Absentee Running Queue. 
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^.l.» Abeonto* initiation Module 

Whenever nOre abeentoe computation* nay be initiated, Load 
Control <eee Chapter 5 aad aeetlon 3.2.3 below) info*** th* 
Ab-iA- Inltletlon Module of th. nunbar bf *B*a to initiate. 

The Abooiitoo iJtt*i«*towiuii^L«*ooido» maoh a*** to initiate 
and make* the appropriate oalla to Initiate the*. The Abeentee 
Initiation Module ealle Abeentee Queae Control to make the 
appropriate lneertione (dolotiono) In tho Aboontoo »B«tn» (Halting) 
Queue*. 

i.i. < Abaontoo ShOlTlttc Modulo 

Hereefter, the ehort-tera auepeaeteti Of ebaehsee ooaptitetiona 

referred to In Chapter 2 la teraod *JftflSla«" **• •*►*•**•• 
eonputatlona. Tho dietinetlon bo^eee* * *hel*»d computation 
and a computation which he* merely bee* Oared ie t*a* -a ahelved 
computation la only ee*e* t em po r ari ly until much time aa the 
system deoides to continue It, wheroaa e eared oonputetlon ean 
only be continued If the uaer loam <$m$M0^&1**&- ! *&- *«***• 
eueh action, "^ffUfUlafi" *• *mmmmr&' mm*9 * ahelTod 
computation and le perftum o d automatically by the Abeentee Monitor. 

Whenever It booonea neeeeeary to decreeee the number of 
running AC* a, Load Control <•****— --**>*' J M J jfffiff*- dainmfriaM Mbdalo 
of how many AC* a to ebelTe. The Abeentee BhelYing Module deoidea 
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which AC* to shelve and Bakes the necessary call* to shelve then. 
Absentee Queue Control le celled to aeke the appropriate 
insertions (deletion*) in the Absentee WeltH^ (Sunning} 
Queues. Mote that shelTing as AC IjwoItm plaaittg an enter 
for it back into the appropriate Abeentee Halting Queue so thet 
the AC again becomes a candidate for Initiation by the Absentee 
Initiation Module. 



hatvaan 4>h* itiuiifu Mont 4- 
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This section discusses the emriroment of the abeentee 
neehaniau. Load Control is discussed here Instead of in 
section 3.1 only because its functions are related to both 
IC's end AC's. However, Load Control is a oritieal portion 
of the abeentee neehanisn and is discussed in detail in Chapter 5. 



Sratau Conj trofr is the nodule whloh proeessee eonnand requests 
fron the systen adnlhietrative personnel. In particular. Systen 
Control conveys the AC-IC apportlonient information fron 
the Systen Administrator to Load Control, and tile dedicated 
resource apportlonnent lnfomatlon to the Reeerrer. 



2i2i? ?frtWBeW ffffjffHTfl?nt 

Periodic deteminatlon of the current anounte of lnteraetlre 
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and absentee usage being supported by the system is essential 
to the operation of the load-balancing mechanism* Performance 
Measnreaent obtains these usage statistics by observing various 
system paraaeters and conveys the inforaation to Load Control. 

-j.2.1 Load Control 

The sain functions of the Load Control nodule arei 

1 - to see that the apportionment of resources between 

interactire aM absentee eos^tttetloas reaains close 
to that specified by the System Administrator 

2 -to cater to short-term variations in the deaands 

upon the system's resources by dynamically varying 
the current resource apportionment 

3 - to see that the system is neither under- not over- 

loaded. 
Load Control compares the apportionment information it receives 
from the System Administrator with the current usage statistics 
supplied by Performance Measurement, If any significant discrepancies 
exist between these sets of figures, then Load Control may modify 
the system load by any of the following means i 

1 - call the Absentee Initiation Module to initiate 

more AC*s 

2 - oall the Absentee Shelving Module to shelve some AG's 

3 - increase the maximum number of IC's allowed 
*f - decrease the maximum number of IC's allowed 
5 - automatically log out some IC's 
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3.2.*» Load Control Table 

In this table, Load Control maintains a list of all logged-ln 
ZC's and oertaln additional lnforaatlon suoh as the total number 
of logged-in XC*s and the maximum number of IC*e which the 
systea currently allows. During the load-balancing operations, 
Load Control obtains lnforaatlon about AC* a from the Absentee 
Waiting Queues and the Absentee Running Queues and about IC*s 
from the Load Control Table. 

3.2.5 Reserve* 

The Reaarvpr is responsible for scheduling the usage of 
dedicated resources (for both IC's and AC* a). If a user's 
AC requires dedicated resources, the user must place an advance 
reservation for the resources. The systea automatically 
Initiates the AC when the reservation becomes due. 

3.2.6 SAVE. RESUME, and QUIT 

These aeehanlsas are provided in the multiple-access computer 
system to facilitate certain manipulations of ooaputations useful 
to both AC's and IC's. QUIT is oalled to stop the execution 
of a computation and plaee the computation into a state in which 
it nay be easily preserved, lost, or continued. SAVE Is used to 
preserve the computation In its current state so that the computation 
may be continued in the future. RESUME is used to continue 
a SAVEd ooaputation. 
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Shelving an AC involves first QUITting the AG, than SAVBing 
it, deleting the Absent** Running Queue .entry, Cor it, oreating 
an absents* soures file containing a BBfflWO eonaand, and placing 
an entry for this file in the appropriate Absentee Waiting Queue. 
Uashelvlng en AC is done by the Absentee Initiation Nodule in the 
sea* fashion as initiating a new AC. However, alno* the absentee 
source file for this AC oonsists of aerelr a K80MB nnawsnrt to 
resuae a SAVBd file, the eared AC is restarted. 



3i?i7 Pfff ft 

Users are provided with a detailed. set of eaaavands with whioh 
to control the initiation, operation, and teraination of absentee 
ooaputatlons (see Chapter 5 ). Thee* eoaaands oauae calls to 
entries in the Absentee Monitor and status inf onamtlon is returned 
to the user in each ease to indicate if th* calls are 
successful. 
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CHAPTBH 4 
Features of the Qucuelng Meohanlsa 



The Queuelmt Mechanise ooneists of the ttrntM Waiting 
Queues, Absentee Sunning Queues, and the Abeentee Queue Control 
nodule. Thie ohepter deeoribes the structures of the various 
queues end the operation of Absentee Queue Control. 



'til 3mi 

taring the operation of the ayatea, user requests to 
initiate nan AC* s Bay arrive faster than -the- naa* AO^s 
can be initiated. One reason f or this is. that the aaxlBUB 
nuaber of AG's uhieh nay run slaultaneously nay be Halted, thus 
necessitating the plaeeaent of waiting requests into a waiting 
line or ensue.. Actually, s quauetng neehnhisn oan be asolded 
If it is fait bjr «ie systea designers that if there eurrently is 
no rooa for acre AC»s, then the user shouM retry Ms request 
at a later tine. This, la effect, is the aethod used in the 
ease of new lnteractlTe users. If the new TC cannot be initiated 
the user aust wait untu a later tine and than raatteapt to log in. 
The reason f&r thia ehaloe is ob^ous. aoppeee, for exaaple, that 
an lnteractlTe user tries to log in and that the systaa cannot 
handle any aore lnteractlTe users now. Suppose that the systea 
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then proceeds to enqueue this user** request in a waiting 
line with other requests for IC»s. Clearly, there is no way 
to tell how ions it will be before the new request nay be 
■errieed. Thus, the user night sit faithfully at his eonsole 
for several ninutes or perhaps several hours before his request 
say be serviced. Prom the huash factor* standpoint which is 
so critical in the defrign considerations for a aultlple-aecess 
eonputer sy stea, suoh an ooourrenoe is not tolerable. 

However, sinoe a user does not have to be present town 
his absentee computation, it la ol ear that requests for AC»s 
may be enqueued for future initiation without any inconvenience 
for the user. As a natter of fact, In this way the user is 
assured that his AC will be initiated at the earliest possible 
tine. As will beeoae clear in Chapter 5t this feature of 
absentee computations is most critical to the design and operation 
of the load-balancing aeehanlsa. 

a, a crnau, mcclullne 

The order in whioh requests to Initiate new AC* s are serviced 
need not necessarily be the sane as the order in which these 
requests arrive. The method of choosing the next AC to be initiated 
from the queues is referred to as the ggcy« dlaelnllno. Anong the 
aore canon queue disciplines are first-in-flrst-out tflfo) which 
selects entries on a firstH»os^first-e«rved basis, and last-ln-f irst- 
o»t (44*o) whleh selects entries o» * **m*«eMwett*-firs*-ser*ed basis. 
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The queue discipline ahosen for the Absentee Waiting Queues 

end Absentee Sunning Queues utilises both fif o end llfo disciplines 

In a Slightly modified fashion. 

The C.T.S.S. system uses a flfo discipline in which at 
nost one absentee computation may run at * time. Once an AC 
has begun to run it must be run to completion or until it is 
automatically logged out. No provision is made to allow the 
running computation to be temporarily suspended and then resumed. 
Absentee usage is never too significant a portion of total 
system usage since there is usually a single running absentee 
computation and as many as 30 running Interactive computations. 
Hence, the suspension of the single absentee computation is not 
really a versatile tool in terms of allowing more interactive 
usage to occur . Figure J».l illustrates the C.T.S.S. oueuelng 
mechanism for absentee computations. 

•3 mj, new entries added at back of queue 



& 



WAITING 

ABSENTEE 

COMPUTATIONS 



e 

1 



3 



next entry to be initiated 



RU NNING 

ABSENTEE ,— , 

COMPUTATION ' • ** only one AC may run at a time 

Figure 4.1 ' 

C.T.S.S. Absentee Queueing Mechanism 
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An obvious extension to the C.T.S.S. queuaing mechanism 
Is to allow many ACa to ran kt one tin*. Thiis introduces some 
interesting load considerations sine* It sight result in a system 
with a poor lnteraotire response If the number of running AC a 
becomes large. This problem ia discussed in detail in Oiapter 5* 
Figure ' k, 2 illustrates a queueing mechanism whloh allows for 
many running AC a at one tine. 



WA ITING 

ABSENTEE 

CONFUTATIONS 



c 



new entries added at 
baok of queue 



next entry to be initiated 



BUNKING 
CONFUTATIONS 



■any running AC a 
(preoiae number of 
ACe United by the 
system's load eontrol 
meehanisa) 



=3 



Figure k.2 

Fifo Heohanlaa with Multiple Running AC a 
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Note that the structure of the aeehanism of Figure ft-. 3 
allows arbitrary criteria to be used In deciding the ordering 
6f the entries In the running queue. The lifo discipline is 
particularly useful for the extension made to this structure 
in the next section. 



fr.S Coemutetlon Stre— 

Wow let us Consider the idee of shelrlng en absentee 
computation. BltttJe -a user Is generally not present to control 
his absentee computation, the user does hot suffer any 
Inconvenience if his ooaputatlon is temporarily suspended 
and automatically resumed. As has been mentioned previously, 
this property of AC*s facilitates the design of the load 
balancing ■eehanisa presented in Chapter 5. In this section, 
the ■eehanisa of Figure 4.3 is extended to allow the reaoral 
of an entry from the running queue and placement of this 
entry back into the waiting queue. 

Figure kA illustrates this new mechanism which is 
referred to as a commutation stream . The stream consists of a 
first-in-first-out queue of waiting AC»s and a lest-ln-first-out 
queue whose entries point to the rariouB running AC* s. User 
requests for new AC's cause entries to be placed at the back 
of the waiting queue. The entry at the front of the waiting 
queue is next to be Initiated. The entry at the front (last-in) 
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ABSENTEE 

WAITING 

QUEUE 



o 




bottom of fif o waiting queue 



ABSENTEE 

RUNNING 

QUEUE 



top of f If 6 waiting queue 

when the AC at the top of 
$ha running queue Is 
■helved, it is placed at 
the top of the waiting queue 
when the entry at the top 
of the waiting queue is 
Initiated, it 1* placed on 

top**? fffl*rV«^«» ue 



bottom' of life running queue 



pointers to 
running AC'S 



Figure 4.4 

A Computation Stream 
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of the running queue is the first to be ahelved when any AC'a 
are to be shelved. Also this entry, when shelTed, la placed 
back onto the front of the waiting queue and henoe it beooaes 
the flrat entry to be initiated again when more AC'a are to be 
initiated. The entry at the back of the running queue (flret-ln) 
is the last entry to be shelved whenever AC'S are to be ahelTed. 

This streaa meohanlsm gives us the ability to increase 
and decrease the absentee load a§« dictated by the load 
balancing mechanism, while at the came tine assuring automatic 
completion of all AC'a regardless of whether they are ever 
shelved for any reason. 



».6.Flow of a Computation through a Streaa 

Figure <t.5 illustrates the flow of an AC through a 
computation streaa. Since an AC nay be shelved and unshelved 
■any tines as it runs, the entry for the AC nay pass back and 
forth through the waiting and running queues until it eventually 
reaches completion while residing in the running queue. Note 
that it is possible for an AC to leave the streaa while it is 
in the waiting queue. This happens, for example, if the user 
decides to terminate the AC. Chapter 6 discusses user control 
of AC's in detail. 
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WAITING 
QUEUE 
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(2X- 



(3)" 



ABSBNTBE 
RUNNING 
QUEUE 
(LIPO) 
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WAITING QUEUE FLOW 

(1) AC enters the stress 

(l)+(2) AC sores toward the 
{2M3J front of the ml ting 
queue as others AC's 

before it' 1 -*** 
initiated 

(3)+(2) AC sores toward the 
, (2)*(1) rear of the waiting 
queue as soae 
running AC's 
shelved 



■mxnt BgrVKHW QUEUES 

(3)e(l») AC is initiated 
(or unshelTed) 

CO +(3) AC Is shelved 

mimnMG oubus plow 

(4)»(5) AC sores towards the 
(5)*<6) rear of the running 
queue as other AC's 
initiated before It 
are completed 

AC soves towards the 
front of the running 
queue sis other AC's 
initiated after It 
are shelved 



(6M5) 
(5)*(*) 



(6) 



An AC nay be eospleted 
regardless of It's 
position in the running 
queue. The AC'S entry Is 
deleted and all other 
AC entries aalntaln their 
sane relative positions 
in the running queue. 



Figure k.5 ._ 

Flow of a Computation through a Stress 
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4.7 Multlnle Strega aueuelng Mechanism 

It la apparent from the discussion of section 4.5 that 
* stream-type queueing mechanism coupled with • load eontrol 
mechanism which orders the shelving end unshelvlng of AC's 
Is a useful Beans of controlling the amount of absentee usage 
supported toy the system. An even greater degree of eontrol 
over the absentee usage is made available by utilising a 
multiple stream queueing mechanism. Thus, it may be advantageous 
to differentiate between various types of .absentee computations 
(such as might be done in the implementation of a priority soheme) 
and such a differentiation could be made by associating AC'S of 
each type with a distinct stream. Then, the load control 
mechanism could eontrol the usage in each stream individually. 
These operations are described in detail in Chapter 5. 

Figure 4,6 Illustrates a mutiple stream queueing mechanism. 
Sote that no reference has been made so far to a means of 
ordering interactive computations or differentiating between 
various types of IC*s. This has been so because our primary 
concern has been considerations related to absentee, computations. 
The discussion of Chapter 5 Includes several such considerations 
of IC's. 
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CHAPTER 5 
Load Control 



When both interactive and absentee computations may 
run together In a multiple access computer system, It becomes 
necessary to apportion system resources and computing capability 
between the two modes. This chapter discusses how suoh an 
apportionment is made, adhered to, and dynamically adjusted 
by the system to maintain itself at efficient operating levels. 



ft.l Terminology 

The sum total of the demands made upon the system's 
computing capabilities by all computations on the system is 
referred to as the system load . Depending upon the capabilities 
of the particular computer system in question, the system 
may operate efficiently over a wide range of load situations. 
Generally, on a large-scale time-sharing system many 
computations may run simultaneously, but there is a limit 
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to the Baxter of eonputatloa* wMoft the. syaten eafc support 
ettheut toeeoalhg ever loaded. 

A* a neaaure of systaa load we no* the n unber of running 
ooapetation*. The ftre*n lood in- « oonptttatlott s trees Is the 
nunber of running eonputfttiotts in that ali e aa . The l£reejL_bj&kuj2 
in a conputation streen is tiM nue&er of oanputatlene in the 
waiting queue for that atraan. frtreen heeltap la a neaaure of 
potantial stroan load. The systems load qopf|ff|r*,f 12S 1» • 
au nnary Of tha streen load and strennt beetu^'fa*' eanh of the 
araten' a eoapwtatlon atraan*. 

For any particular nultlpla aeeaaa eeaputer systeu, th* 
ao*t affieiant load configuration (i.a. , tha load configuration 
which result* in tha noat useful confutation) ia difficult to 
predict while the eyetea is under developnant. after the 
ayetea b a e a n oe operational, howevsr; efficient lead configurations 
rssdily bsoene apparent. a aaatipie aaeeaa ; eeaputer araten is 
mmA* *^ >m tTTtfcf lT-1 ?lflff if it la operatl**' na*r Its noat 
efficient load configuration, orcr+ioaacd W there la less 
useful c o nputati on being pa rf o ra o d than when the ayetea is In 
its nost efficient load configuration, and naftor*lonicd if the 
addition of acre computations would result in an increased 
aneunt of uaefui conputation. Theaa tern* ear elao be need to 
describe the loed in a ponputatlon atraan. In particular, a 
stream which nerually serrioee seven eonpetatioaa-ls over-loaded 
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if nine ooaputatlone are currently running in that .treea, 
under-loaded with five running confutation*, and properly-loaded 
»rtth »«t«b rwmlng ccapetetlone. 

The jogd, MB^r9l nrefclen la to aeiatain the ayate* In 
* propurly-leaded ; state. It a aretan ie operating la 
•a under-loaded etate, the load oontrel part**, u t* laoreaee 
the auabar of running eonpntatloae. If aiayatea la operating 
la an orer-loeded atate, the load control nretgap la to 
deereaae the morter of naming eoafmtattaae. If a •yetea ju 
operating in a properly-loaded etate. the load control prenlea 
la to maintain thia etate. 



fcrol ln» Purely ftfl 
eonaidar the load eon**** problen in -a ,j*pta* a^natad* 
to eemelng only lnteraetiw eoeputatloae. The eyetca load, L, 
la equal to the naaber of running XWej^v., **»;. -fJKpJjpp recoureec 
are a*allrt^th,;thd»airlou» !<?••. ~ It,^on^,neaeaap«y,to 
Unit the nuaber of ip** to none L angina** Ji^ ^wm**: **■<■ 
ayaten fron feeonlng ercr-loaded <«4 IC»* therefore correeponda 
to a properly-loaded atnte). Tk» K $r*t m ^*to^ t ^ wmmBa 
an initial value of Hi at etertup, ^m-m$gm^ :&m H ** *** 
tlae during axeten operation. 

Figure 5.1 ahewe a alanle load eontral aeehanice f or a 
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Cj 9 current number of 
running IC*a 



Figure 5.1 Load Control in a 
Purely Interactive 
System 
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purely Interactive ay stem. When a new IC attempts to log In 
Load Control oheeks to see If the number of IC's, C^ t 
currently on the system is less than the allowed maximum. 
If C^ is less than M if the IC Is allowed to log in and 
C 4 Is lnoreaented by one. If C i Is greater than or equal to 
M^.then the IC may hot log in now t a new attempt to log In 
aust be aade at a later tine. When a running IC logs out 
C A Is decremented by One. 

The System Administrator nay reset ■! while the system 
la in operation. Load Control oheeks to see If M* Is less 
than C 1( If not, thai no adjustments In the ourrent IC 
load are needed. However, If Mj Is less than Ci the system 
automatically assumes an over-loaded state and Cj*llj/ 
running IC's must be logged out to bring the IC load down to a 
properly-loaded state. Decreasing the number of running 
computations Is referred to as 



The most direct way to trim the IC load Is to Immediately 
log out the necessary number of IC's. (Ifote that It is therefore 
desirable to associate some ordering with the IC's in order to 
have a criterion for choosing which IC's to log out first. See 
section 5.7 for a discussion of Interactive computation streams. ) 
Such a strategy is referred to as a trla-br-force and is 
illustrated in Figure 5,2. 
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In this example, the load is to be trimmed to P IC's. 
If C, is less than op equal to P then no adjustments in the 
load are needed. However, if C ± is greater than P, then 
IC's are automatically logged out one-by-one until C ± equals P. 

From the system's viewpoint, the load trim-by-force is 
a quick and sure means of decreasing the IC load. However, 
the trim-by-foree results in inconvenience to the IC's which 
are logged out. since they cannot run to completion now, and 
they may have to wait quite a while before they may log in 
again to continue their work. Prom the human factors 
standpoint it might be reasonable to adopt a continuous 
service policy towards IC's. This policy would then require 
a more flexible load trimming strategy which is referred to 
as load w- ^.Attrition and is illustrated in Figure 5.3. 

In this example, the load is to be trlmmed-by-attrition 
to P IC's. If C t is already less than or equal to P, then no 
adjustments in the load are necessary. However, if Cj_ is 
greater than P, then the load Is decreased to P as Cj-P IC's 
voluntarily log out. This is a gradual process, since the 
load deoreases at the same rate as voluntary IC logouts. The 
IC's on the system at the time the load trimming begins do not 
undergo any inconvenience i they may run to completion and log 
out when they are done. However, onoe an IC logs out, it may 
not log in again until Cj. becomes less than P. The 
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Figure 5.3 Load Trlm-by-Attrition 
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trim-by-attrition strategy dees have one significant drawback. 
If the IC's on the system do not log out In a short tine, they 
can remain on the system as long as they would like to and thus 
prevent the load from being trimmed. In such a ease it might 
be reasonable to Impose some time limit on the Toluntary 
logouts, and if the load has not been trimmed to ? IC*s by 
that time, then a trlm-by-foroe could be used to Complete the 
load trimming. If it is required that the IC load be trimmed 
to F by a certain time, then the load trimming could be 
initiated in advance of this time. Figure $,k illustrates 
the various load trimming strategies discussed in this section. 



frk Load Control %n a, SHyfle-Stroam, Purely Absentee System 

Now consider the load control problem in a system dedicated 
to servloing only absentee computations. The system load, L, 
is equal to the number of running AC'S. The System Administrator 
specifies the maximum number of running AG's, N a , at startup 
time and may alter M a at any time during system operation. 

Figure 5.5 shows a load control meohani am for a purely 
absentee system utilizing the computation stream concept 
discussed In Chapter k. When a user enters a request for an 
AC, Load Control oheoks to see if the number of running AC'S, C^, 
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Figure 5*5 Load Control in a Single-Stream 
Purely Absentee System 
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Is less than the allowed maximum. If C „ is not lefts than M 

ar a 

then the AC cannot be Initiated now and mast wait in the 
computation stress's waiting queue. The nuaber of AC*s 
waiting to be initiated, C aw , is incremented by one. 
If C^ is less than H a then the AC can be initiated immediately. 
C^p is incremented by one and an entry for this AC is placed 
into the computation stream's running queue. 

When a running AC logs out C^ is decremented by one 
and the running queue entry for the AC Is deleted. If this 
causes <:„ to fall below M a then more AC »s may be initiated. 
Load Control checks to see if any AC»s are waiting to be initiated 
and if so initiates enough AC s to bring the Ac load back 
up to M a , 

The System Administrator may Increase or decrease M. while 
the system is in operation. If M is decreased so that It 

■ & 

becomes less than Car then Load Control orders Cgo—t^ AC's 
shelved. If M a is increased to a value greater than C a _ then 
Load Control orders Mg-C^ AC»s unshelved. Kote that if the 
AC load has to be decreased (i.e. , M„ is set to a value less 
than Cgj.) then it is reasonable to immediately shelve the 
necessary number of AC«s. The method of load trlm-by-ettritlon 
need not be used since the shelved AC's do not undergo any 
inconvenience in the sense that a bumped IC does. Thus the 
AC load is only trimmed by a load trim-by-force. 
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5.4 Load Control In e HulttpU 

How lot no extend the dleoueeion of action 5.3 to 
include the load control problem in, a aultlple*streca purely 
absentee systea. In particular, ooneider e aystea coaprlBed 
of n absentee streams. The following definition* will be 
useful In the dlseussloni 

M (iy m maximum nuaber of AC»s which may run in stream 
**' i at one time 

C ar( 1) " eurrMl * number of AC»s rtthnlng in stream i 

c mw( IV" o*"* 11 * nuaber of AC' s waiting to be run in 
awm stream l 

H -JDL/.i - maxlaua nuaber of AC*« afeieh aay run on 
i»l A ' the entire systea at one time 

H »Sc m m current nuaber of AC'S running on the 
U1 arii) antlre systea ; 

¥ •^ C awli» • ww** ttuaber of m** welting to ,bs 
i»l •"»*■' run on the systea **• 

The aystea Administrator apportion* resources by 
specifying \ lt y for each stream. The sua of these, M, 
therefore repreasnts what the Administrator ooaaiders to be 
the aaziaua nuaber of AC' s which aay run at oae Uae and still 
keep the systea operating la a properly-loaded s*a*s., la effect 
the Administrator specifies that X a*o&| ara arallabl* f or 
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use by AC g. At any tine a particular slot is either 
empty or in use. Since H running AG's re p r esent s a properly- 
loaded systea, the load control problem is to maintain the 
system so that either N or fewer slots are in use* If acre 
than M AC Is are running Load Control must trim the load to 
M. If less than M AC*s are running Load Control must 
cheek to see If any AC'S are waiting and if so initiate 
enough AC'S to get the load back up to K. The funetione to 
be performed seem clear, but toe fact that mere than one 
stream is involved introduces some complications. For example, 
it Is possible that one stream oould be properly-loaded and 
all the other streams could be empty. If there are AC's 
waiting to be run in the properly-loaded stream, they must 
wait until running AC's in that stream log out before they 
may be initiated. This is obviously a waste Of systea resources 
since the "oomputlng power" Is available to handle more AC's 
and it is not being used. One solution to this problem might 
be to allow toe waiting AC's to run in other streams. This 
is satisfactory until such time as new AC's arrive and request 
to be Initiated into streams which might be full of AC's from 
other streams. Should these new AC's also be placed into streams 
in which they too do not belong? In this section a strategy 
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Is developed to prevent this sort of chaos while at the same 
time assuring that system computing power does not go to mate 
If there are waiting AC's which could use that power* 

Recalling some definitions given In Section 5.1 a 
particular stream Is properly-loaded if c ar n )"*L/*\» under- 
loaded If c ar m( M a mi and over-loaded if C^/.^M .. .. The 
load In a particular stream is said to be bj&anajg. if the 
stream is properly-loaded, or if the stream is under-loaded 
and no AC's are waiting to be run in that stream. 

One solution to the load control problem in a multiple* 
stream system might be to balance the load in each stream 
Independently of any considerations involving the other streams. 
This would result in a system in which 

C ar(i)^ M a(i) for 1 " lf 2 * '*" n 
and hence it would always be true that 

l»i ar **y 
The Ideal situation is S m M, However, the above oomponont- 
wlse- balanced system may have H ^"M.even while there are some 
waiting AC's (i.e., the situation presented in the beginning 
of this section). 

To see how the situation in which B<# and W^O can be 
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avoided, let us trace the buildup of the load on a 
multiple-stream system starting with no running or waiting 
AC's. As requests to initiate new AC's arrive, Load Control 
observes that the current load In each stream is less than 
the allowed maximum and therefore allows the AC's to be 
initiated. After a while, however » one of the streams will 
eventually become properly-loaded. Suppose that another 
AC requests to be placed Into the properly-loaded stream. 
Load Control cheeks the load in this stream and discovers 
that the stream is full. Load Control can then check the 
loads in the other streams to see if there are any available 
slots. If there is an available slot, Load Control allows 
this new AC to be initiated. This, of course, causes 
a properly-loaded stream to become over-loaded. However, the 
system as a whole is not over-loaded and therefore by initiating 
this new AC into an already properly-loaded stream we are 
preventing usable resources from going to waste. 

Load Control may continue to allow new AC's to be 
initiated until R becomes equal to N. Onoe this occurs the 
addition of another running AC would cause a genuine over-loaded 
situation. Now Load Control must first check to see if the 
new AC wishes to be initiated into a stream which is either 
properly-loaded or over-loaded. If this is the case then the 
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new AC la placed into the welting fangs fag the,* eta Bo a to erold 
over-loading the eyatea. If, however , the etreea into 
whleh thla AC wiahea to be pleeed la under-loaded, then 
sone other etreea anst be over-loaded eauelng ell elota to 
be In bee. She only reason that thle ether streaa was allowed 
to use aore then lte eaxinua nuaber of slots waa to prevent 
•Tellable reaovroea froa being wasted, now, ho wever, there 
la legitlaet* deaend for these resoarees and they ehoold be 
given book to the AC which la specifically requeetlng then. 
Thle posea no real problea to Load Control. It la aerely 
neeeeaary to ahelve one AC f roa the orer-loeded etreea so that 
the needed clot beooaea available In whleh to Initiate the 
new AC. Thla procedure le followed aS additional AC a request 
to be initiated until finally the aystea reaohea a load 
configuration in whleh every etreea le properly-loaded and 
there nay or aay not be AC s waiting to be initiated in any 
of the atreaaa. Thi* situation le re f erre d to as the 
Ideal load oonflaaratlon for obvious reasons. 

How consider the load control functions whleh auet be 
perforaed when a running AC logs out. Since we know that 
B waa always kept leee then or equal to K as the load waa 
building up, it suet be true that a slot le node available 
(i.e.,; it can hot be the ease that the eyatea went froa 
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one over-loaded state to a less over-loaded stats). Load 
Control mist now deolde whioh waiting AC (If there is any) 
to initiate into the newly available slot. First preference 
for the slot goes of course to any AC'S waiting in that 
particular stress. Hots that if the scheme proposed in this 
section for initiating new AC' s is used, then it is not possible 
for an AC to be waiting in a stream which is tmder-loaded. 
Therefore if no AC is waiting in the stress in whioh an 
AC just logged out, then Load Control must initiate one of the 
AC's waiting in any of the properly-loaded or over-loaded 
streams. 

Thus ws hate arriTed at a soheas for initiating and 
shelving AC's which assures that available slots never go to 
waste if there is demand for then, while at ths same time 
we hare developed a mechanism which guarantees an AC first 
priority in Claiming slots allocated to the stream in which 
that AC wishes to run. Figure 5.6 illustrates ths load 
control operations discussed in this seotlon. The reapportionment 
funotion is treated separately in the next section because 
of its complexity in a multiple-stream system. 
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Figure 5. 6 Load Control In a Multiple-Stream 
Purely Absentee System 
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In Section 5. 5 requests for new AC'S and logouts of 
running AC's were handled In an orderly fashion to prevent 
the overall system from becoming overloaded, The scheme 
presented never requires the system to become temporarily 
overloaded while in the process of adjusting to its new 
load configuration. When the system load Is reapportioned 
by the System Administrator, however, each stream as well as 
the entire system might become overloaded and thus it is 
necessary to provide a mechanism for quickly adjusting the 
overall system to a properly-loaded state. Besides the load 
trimming which may be necessary, it is also possible that 
the load balance within the streams may become severely 
distorted by a reapportionment. In this section a strategy 
is presented for quickly and smoothly readjusting the system 
load configuration after a reapportionment. *he load control 
operations necessary for reapportionment are illustrated in 
Figure 5.7. 

To effect the reapportionment, : the System Administrator 
specifies new values of M^jj through "*(„). Load Control 
first cheeks to see If the overall system has assumed an 
overloaded state (R>M). If It has then R-M AC's are 
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Figure 5.7 Load Reapportionment In a Multiple- 
Streaa Purely Absentee System 
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ianedletely shelTod f ron sone of the orer-loedod streeno. 
Then Load Control proceeds to belanoe the mulwlur of the 
load* an operation which is discussed later in this section. 
The question arises borons to kbit y*o choose AC s to be 
shelred. Sereral orlterle ore useful 4m making this decision, 
but perhaps the most significant lo to assume thnt there 
Is none ordering among the various streams (i.e.. nsoune 
eeoh stream correspond* to a different priority in * priority 
scheme). Sau the first AC to be Shelved is one of the 
AC's in the over-loaded strean of lowest priority, Similarly, 
a strategy to use for selecting AG's to be initiated might 
be to initiate an AC uniting In the atreen of highest priority, 
ffote that within the strsam itself there l* never any ambiguity 
as to whleh AC should be seleeted f or shelving or initiation. 
The entry at the front of the waiting queue Is always the 
next to be Initiated t the entry last-in to the running queue 
Is next to be shelred. 

If the reapportionment causes the overall systen to 
become properly-loaded (&Jf) then it is still possible that 
some adjustments have to be made and the balancing neohanisn 
is Invoked, 

If reapportlonnent causes the overall systen to becone 
under-loaded (H<M) then the situation beoones more complex 
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depending upon how many AC's are waiting to be Initiated 
and whether or not these AC'S are waiting in under-loaded 
streams. If the total number of waiting AC* s in all streams 
is less than or equal to ttie under-load (M-R) then all the 
waiting AC'S may be initiated and the reapportionment 
operations are complete. If the number of waiting AC'S is 
greater than the under-load then we must consider just how 
many of these waiting AC*s are really entitled to be run in 
their respeotiTe streams. More speolfieally. we are interested 
in the number of AG's which are waiting to be run in 
under-loaded streams, and of these we are only Interested In the 
first M^^^^jwaitia^AC's in eaoh stream (since 
Initiating aore than this amount would cause the stream to 
become over-loaded), we refer to the number of AC'S satisfying 
these conditions as the proper-demand , and define 

proper-demand . W p m ^ fmlnimum(M B{1) - ^^y . Cawd)*] 

all 

under-loaded 

streams 

If the proper-demand is less than the under-load Load Control 
immediately Initiates all of the proper-demand waiting AC's. 
Now R is still less than M, but every one of the AC's entitled 
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to be running is running. Load Control now Initiate* 

H - (B + V ) additional AC*a to bring the lead as to M 
P 

the reappertionaent la eoaplete. If » . la greater than 
the under-load Load Control iaaedlateljr initiates M-H of 
the proper-deaand waiting AC* s, but the reapportionment la 
not yet ooaplete since more pr op e r-d ea a nd AC* a era Still 
waiting, and henee the load balanoing aeehaniaa anst 
be invoked. 

FroSrtae preceding disouaalontt 1* clear that the 
load balanoing aeohanisa la called upon whenever Lead Control 
haa aeeertalned that BmM, but there way etlU be eoae 
proper-deaand waiting AC*s which anst replace AC'S running 
in over-loaded atreaas. The balanoing aechattlaa eheoka to 
see if titers are indeed any proper-deaand waiting AC'S. If 
not the reapportionaent is ooaplete; If there are then 
Load Control shelves one AC froa the lowest priority over- 
loaded stress and initiates one AC into the highest-priority 
underloaded atreaa. This piroedure continues until there 
are no additional proper-deaand waiting AC* a. 

To suaaarlse aectlona 5.5 and 5.6, a aeehaniaa haa been 
presented to perfata efficiently the load ooatrol operations 
required in a aultlple-atreaa purely absentee systea. The 
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mechanism has the following significant characteristics t 

1 - The System Administrator oan control Vtm amount 

of absentee usage In each computation stream by 
specifying the maximum number of AC*s which may 
run in that stream at one time. 

2 - The mechanism prevents waste of available slots 

by allowing properly-leaded streams to become 
over-loaded as long as there is no demand for these 
slots from AC's in the streams to whleh the slots 
belong, 

3 - The mechanism guarantees an AC first claim: to 

slots in its own stream. If all slots on the 
system are in use whan an AC requests one of its 
rightful slots then an AC is shelved from one of 
the over-loaded streams* 

k - The System Administrator is provided with the ability 
to reapportion the loads In the various streams at 
any time during system operation. 

5 - The'ueohaniaa-is constructed in such a way as to 

comply quickly and effloieiently with reapportionment 
requests from the System Administrator. If a 
reapportionment causes the system to assume an over- 
loaded state, the over-load is oorreoted quiokly 
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so that the system operates with an over-lead for 
the shortest possible time, and then any balancing 
which must be done to assure AC s first claim to their 
own stream's slots is done on -«- *shelTe-one-lnltiate«one a 
basis to keep the system operating with all slots in 
use. 



5,7 Load Control in a Hnltlple-Straam Purely Interactive Sarsten 

How consider a system devoted to servicing only 
interactive computations. One Improvement which might be 
made to the soheme in Section 5.2 is to consider that there 
is some ordering associated with the running IC's which indicates 
the next ZC to be logged eut in the event that such action 
is indeed necessary. By analogy to the case of absentee 
computations we define here the notion ef an interactive 
computation stream, furthering the analogy we assume that it 
is desirable for some reason (such as a priority soheme) to 
differentiate between various types of IC's. Thus we arrive 
at a multiple-stream mechanism for handling interactive 
computations similar to the absentee mechanism described in 
Seotlons 5.5 and 5.6. In this section we consider the 
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modifications which oust be made to adapt the absentee 
mechanism to the handling of lnteraotlTe computation*. 

Bote Immediately that there are no Halting queues in 
the lnteractire streams* This is the case because a user 
is only present for as long as it takes for his logging in 
attempt. Thus it is not meaningful to consider lnteraotlTe 
demand at this lerel. 

Next consider the problem of attempting to fill all 
lnteraotlTe slots if the demand for thwt,e*a*t«. If the 
system load operates at a lerel such that no stream erer 
beoomes properly-loaded then the load control operations 
are identical to those in the absentee meehanlsa. However, 
suppose that one stream does become properly-loaded while 
some other streams remain under-loaded. If a new IC should 
request to be initiated Into the properly-leaded stream, Load 
Control has only two choices. Either It can Initiate the 
IC and over-load the stream, or it can refuse to initiate 
the ZC (i.e.., the IC cannot be placed into a waiting queue 
for an indefinite period until a slot becomes arallable). 
If Initiation is refused then waste oeours because vti arallable 
slot goes unused. If the IC is initiated then thi* waste is 
prevented, but another problem arises, what happens when 
the overall system becomes properly-loaded (i.e., no more 
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available Interactive slots), and a user attempts to log 
Into an under-loaded stream* In the ease of the absentee 
mechanism it was possible to make a slot available immediately 
by shelving one AC from an over-loaded stream. In the 
Interactive ease, however, making a slot available would 
necessitate logging out an IC from an «ver-loadeft stream. 
This is contrary to the continuous service policy discussed 
in Section 5,2. Several alternatives are available here, but 
unfortunately none of them is as neat as the shelving of am 
ACi 

1 - Do not allow any streams to become over-loaded. 

Control the load in each stream independently of 
the load in any other stream. This results in a 
component-wlse-balaneed system. The obvious 
disadvantage is that slots available in under-loaded 
streams can never be used by IC's from overloaded 
streams thus causing waste of available slots. 

2 - Allow overflow in all streams. Initiate new IC*s 

into whichever stream they request as long as slots 
are available in any of the stream. Once all slots 
are in use allow no additional IC's until slots 
again become available. This method assures that 
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available slots never so to waste, but baa the. 
disadvantage that IC'S do not get first olaim to 
slots in the streams in which the IC's specify they 
would like to run* 
3 - Allow overflow in all streams, Guarantee completion 
to all IC's once initiated. If a new IC requests to 
be initiated into an under-loaded stream then 
initiate the IC into that stream and trim- the load 
in an overloaded stream by attrition, This method 
prevents waste of available slots and assures IC ' s 
first claim to slots in the streams in which the IC's 
specif iy they would like to run* The disadvantage 
is that the trim-by-attrition might result in a slow 
trim and henoe the overall system might be forced 
to operate In an overloaded state for some time. 
Bach of these methods has its' advantages and disadvantages, 
but none of them is a "perfect" solution. Our inability to 
arrive at such a solution here is attributable to the fact 
that there is no action which may be performed on IC*s to 
correspond to the shelving of AC'S. Thus a particular 
Load Control implementation might choose one of these schemes 
(or perhaps others) depending upon the particular problems 
at that installation. If we assume that the most desirable 
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properties are preventing waste of available slots ami 
guaranteeing IC*a first elalm to the slots In the streaks 
In which these ic»s wish to run, then we arrive at another 
scheme (which is still, incidentally, not a perfect "solution) 
which is similar to the third scheme above, but prevents 
the orerall system from beoomlns overloaded i 

4 - Allow overflow in all streams, however, If an IC 
is initiated Into a properly-loaded or oVer>loaded 
stream then the IC is given seeond-olas* status and 
is warned that his computation: is likely to be 
logged out if the orerall system becomes properly- 
loaded and an IC demands a slot in an under-loaded 
stream, TOiis method does not assure IC«s oontinuous 
service, but still allows an IC to get on and use 
a slot for as long as the slot is not in demand. 
Since the IC is warned of Its seeond-qlass status 
it knows that it is likely to be logged out and hence 
it can take advantage of being logged in to get a 
small job done. Of course, as other IC's log out 
of this over-loaded stream, the IC we are considering 
may eventually be abla to be removed from the over-load 
portion of the stream. At this time the system could 
inform the IC that It is no longer of seeond-olass status. 
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We will assume that this last method Is used for the purpose 
of any further discussions in this thesis. Again, other 
methods might be more desirable In particular installations. 

Mow consider the reapportionment problem in a 
multiple-stream purely interactive system. Since we are 
allowing streams to become over-loaded as long as the overall 
system does not become over-loaded, reapportionment oan 
be handled rather straightforwardly. If the total number 
of running IC's is less than or equal to the maximum allowed, 
then no action need be taken (note that there are no waiting 
IC's to be considered as in the absentee ease). If the 
total number of running IC's is greater than the allowed 
maximum then Load Control logs out IC's from the lowest 
priority over-loaded streams until the number of running IC's 
is equal to the maximum allowed. To aid the IC's which' 
are to be logged out Load Control might warn them a few 
minutes in advance to allow them to "clean up" any details 
before being foroed off the system. 



.8 Load Control In a Hybrid System with Multiple 

In this section we combine the mechanisms developed 
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for handling multiple-stream absentee systems and multlple- 
stream Interactive systems to form a mechanism for handling 
mixed Interactive/absentee systems. (see Figures 5.10 and 5.-11). 

Figure 5*8 Illustrates a multiple-stream queueing 
mechanism for handling a mixed interactive/absentee system. 
For the purposes of this discussion ire assume that there 
are n absentee streams and m interactive streams. Note that 
there are no waiting queues for IC's. This is consistent 
with our previous discussion of interactive streams. 

Figure 5.9 summarizes the parameters used by Load Control 
in making its various load balancing decisions. The reader 
is urged to faaillarisechlmself with the definitions ef these 
parameter* bef or* prBeeea*hg v «£th the f ollowlng discussion 

Previously, we have considered systems which supported 
either IC's or AC's but hot both. In these systems the 
apportionment made by the System Administrator was said to 
divide the system into a certain number of slots, each of 
which was capable of handling one running computation. It 
Is worthwhile to note here that we have aasfcmed in ihls division 
that each slot is t in some sense, of equal size. Thus we have also 
assumed that regardless of the characteristic* of tb* 
computations using the slots, the actual demands placed upon 
the system by these computations i» directly proportional to 
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the number of slots In use. This is obviously a simplifying 
assumption which can be avoided by providing a module oapable 
of deciding Just how "big" the slot need be to effectively 
service a particular computation. With such a module available 
we could proceed to define an *tom*e-slot as the unit of 
computation size measurement. Computation streams could 
then be envisioned to consist of atomic-slots, and each 
computation requesting to be run in a particular stream would 
be granted an appropriate number of atomic-slots In that 
stream. A stream would then be considered properly-loaded 
if all of its' atomic-slots were In use. 

This problem was discussed here because we must again 
make a simplifying assumption, namely that absentee slots 
are the same "size" as interactive slots. From the discussion 
above we can envision ways of avoiding tills assumption, too. 

The System Administrator apportions system computing 
power by specifying the maximum number of computations which 
may run in each of the absentee and interactive streams'* 
Reapportionment may also be done and is discussed later 
in this section. 

When an IC attempts to log in to stream j (h+lrfj^n+m) Load Control 
cheeks to see if the total number of running computations 
on the system is less than the maximum number allowed. If 
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B* Is indeed leas then Hj then the IC is initio*** 
lwaedlately. Bote that Load Control proceeds to oheek 
whether stream j is now over-loaded, «nd if it JLs over-leaded 
the user i» warned that there is a possibility hie IC 
■ay be looted oat (elnoe the elot taken by Ma IC really 
belongs to another etream). If the eyaten is now fall (i.e., 
H,, is eqaal to Hy) then Load Control ohecke *¥ the intefitotive 
"portion" of the ayatam la full. If not then oleerly »oa« 
absentee stream la over-loaded and Lead; Control shelves one 
computation from the lowest priority over-loaded strewn and 
Initiates the IC into stream J again oheeklnt if i is 
OTer-loaded and warning the »■«* if it is. If the interactive 
portion of the system is rull^ Load Control looks «t strew* i 
to see if it is fall. If stream J Is not full then dearly 
one of the interaetive streams is over-loaded and Load Control 
logs oat one IC from the lowest priority over-loaded interaetive 
atrean and Initiates the new IC into stream J* if Stream J 
is full then Lead Control informs the owes that he nay not 
log in at thie time. Rote that one farther alternative la 
atill available to Load Control for attempting to initiate 
this IC now. Load Control ooold eheok if any atrean with 
lower priority than atrean j la overloaded end if so ooold 
then log one IC out of thie stream and Initiate the new IC. 
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This alternative, is avoided here mostly beoause of our 
efforts to provide continuous service (if at all possible) 
to running IC's. 

When a new AC requests to be run in stream i (l*J*n) 
Load Control eheoks to see if the system is full. and, if not, 
initiates the AC immediately. Rote that no warning need 
be given to an AC if stream J is overloaded. If the 
system is full Load Control oheoks if the absentee portion 
of the system is full. If not, than olearly some 
interactive stream is over-loaded and Load Control logs out 
an IC from the lowest priority over-loaded Interactive stream 
and initiates the AC into stream J. If the absentee portion 
of the system is full Load Control oheoks if stream i is 
full. If not, then clearly some other absentee stream is 
over-loaded and Load Control shelves one AC from the lowest 
priority over-loaded stream and initiates the new AC into 
stream J. If stream J is full, then the AC may not be 
Initiated now and Load Control places the AC in the waiting 
queue for stream J. 

Mote that this disoussion and the diagrams of Figure 5*10 
have been simplified by the omission of Some of the queue 
manipulation details prevalent in previous discussions. Thus 
when a computation is said to be initiated or Shelved in 
this disoussion it is meant to be implicit here that these 
manipulations axe .performed when appropriate. 
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When an IC logs out of stream J Load Control checks if 
any AC's are waiting. If there are none then no operations 
are performed. If there are AC's waiting then Load Control 
Initiates one AC. 

When an AC logs out of stream J Load Control eheoks If 
any AC's are waiting In stream J. If there are then Load 
Control Initiates one AC Into stream J» If no AC's are 
waiting In stream 3 Load Control eheoks If AC'S are waiting 
In any other absentee streams. If there: are then one AC is 
initiated. 

Note that in a system in which the load builds up 
under the control of the above mechanism the overall system 
never becomes over-loaded and no AC is ever placed into a waiting 
queue if Slots are available in the stream in which the 
AC wishes to run. Reapportionment, however,, ©an eattse both 
6f these conditions to occur and the methods of alleviating 
these problems will now be discussed. 



5,9 H^are'anciK.^teB; ^"^ ■"'■ w ** 

Figure 5.11 illustrates the operations which must be 
performed by Load Control to smoothly effect a load 
reapportionment ordered by the System Administrator. The 
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mechanism is designed to provide continuous service to those 
computations whioh axe entitled to continue running under the 
hew apportionment, while, at the sane time, quickly 
eliminating (i.e. , shelving AC'S and logging out IC's) those 
computations which should no longer be allowed to run. The 
strategy employed involve* first increasing or decreasing 
the current load until the proper number of slots are in use. 
This results in the system beoomlng pr op er l y-loaded under 
the new apportionment. Than Load Control proceeds to locate 
any AC'S which should be running. If the overall system Is 
still under-loaded when this procedure begins then Load 
Control initiates enough of these AC*s to bring the system 
up to a properly-loaded state. Once the system is properly- 
loaded if : any more waiting AC s should really be running then 
clearly some streams are over-loaded. Load Control 
eliminates one computation from an over-loaded stream and 
initiates One of these AC's. This procedure continues ttttil 
no more of the waiting AC*s should be running. The 
following dlsousslon considers these operations in more 
detail. 

The Administrator effeots « reapportionment by 
respeelf lying the maximum number of computations which may 
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run in «aoh stream in the system. Load Control first checks 
if the total number of running computations is greater than 
the maximum allowed under the new apportionment. If B^ is 
greater than H^, then Load Control must eliminate eomputations 
from over-leaded streams to get the load damn to M^. If the 
number of running AC's, B., is less than or equal to the 
maximum number of AC's allowed. «., then the total over-load 
is made of IC's. Load Control logs oat l^p-H^ of the IC*s in 
over-loaded interactive streams (beginning with the lowest 
priority streams). Once these IC's hare been logged out the 
system is properly-loaded. However, it is still possible that 
the reapportionment caused some of the waiting AC* a to become 
proper-demand waiting AC's and hence Load Control; invokes 
the balancing mechanism to initiate all proper-demand waiting 
AC's and log out enough «ver»loeA-:s«mqiiM»tA«|»xto'-keep--the-- 
System from becoming, over-loaded. 

If R. is greater than M^ then acme AC's must be shelved. 
In particular, if the absentee over-load is greater than the 
total system over-load teen B^-ftp AC's are shelved. If the 
absentee over-load is not greater than the total system 
over-load then all over-load AC's are shelved and then 
enough over-load IC's are logged out to bring the total 
system load down to M_. In each of the above two oases 
the load-balancing mechanism is Invoked after the eliminations. 
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Up to this point we have been considering eases In 
which the overall systea Is over-loaded. Ifsafter «*e 
reapportionaent the overall systea bMOMs TB»«perly' loaded 
(BrpxHp) then It la still possible that soas AC'a hare 
beeoae proper-deaand waiting AC'a and henee the load 
balancing anehanisa la invoked. 

If the reeppertlonent causes the overall systea to 
beooae under-loaded then Load Control aunt firat bring the 
systea up to a proper-loaded state If there la enough AC 
deaand. If the naaber of waiting AC'a la leas than or 
equal to tibte syatea under-load, then all waiting AC* a are 
Initiated and we are done; If there are wore waiting AC* s 
than the systea under-load then Load Control cheek* how 
■any of these AC«e are proper-daaand waiting AG's. If the 
nunher of proper-denend waiting AC'S la great er than the 
under-load then Load Control initiates enough of these to get 
the syatea up to a properly-loaded state and then invokes 
the load balancing aeohanlaa to initiate all of tt» reaalning 
proper-deaaad whiting AG's. If the naaber of- propeywdeaand - 
waiting AC'a la less than or equal to the under-load then 
Load Control initiatee all of the proper-deasnd waiting AC'a 
and then Initiates enough of the reaalning AC'a to taring the 
overall systea up to a properly-loaded state and we ara done* 
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The load balancing mechanism la only invoked when 
the overall system load Is equal to the ffw,Tlmim load allowed 
under the new apportionment. The mechanism oheeks If there 
are any proper-demand waiting AC'S. If not then we are 
done. If there are proper-demand waiting AC's then clearly 
some stream Is over-loaded. We know at this point that 
all slots are In use. Thus it must be true that either 
AC'S are Using all AC slbts and IC's are using all IC slots, 
or one of the modes is using more than its allocated number 
of slots. If both modes are using their allocated slots and 
there are proper-demand waiting AC's then clearly some 
AC's are running in over-loaded streams. Load Control 
shelves one of these over-load AC'S and initiates one proper- 
demand waiting AC and repeats this process until all proper- 
demand waiting AC's have been initiated. If AC's are using 
more than their allocated number of slots then the balancing 
prooedure is the same as if both modes are using their allocated 
slots. However, if IC's are using more than their allocated 
slots then Load Control logs out one overload IC and initiates 
one proper-demand waiting AC. This process continues until 
either the number of running IC's Is equal to the maximum 
number of IC's allowed or all proper-demand waiting AC's are 
initiated. If the first condition is satisfied first then 
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there may still be some proper-demand waiting AC's. Load 
Control handles this by shelving one over-load AC and 
initiating one proper-demand waiting AC and continuing 
this process until all proper-demand waiting AC's have 
been initiated. 
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CHAPTER 6 
Commands for use with Absentee Computations 

Users of the computer system communicate with the 
system by Issuing commands (usually in the form of 
typewritten statements) at remote terminals. This chapter 
discusses a set of commands used by system users and 
administrative personnel to create, monitor, and terminate 
absentee computations. The discussion here is less detailed 
than In Chapters k and 5 i it Is included to illustrate 
what functions might usefully be controlled at the command 
level. 



6 i* ffreftH»ff W AC 

Creating an AC involves two functions. First, the 
identification of the user must be validated to prevent 
unauthorized access to the system. Second, the user must 
inform the system of the absentee Source film- which is to 
be used for input to the computation, and the absentee output 
file whioh is to receive output from the computation. 
Additional parameters are supplied to specify in which 
stream the user wishes his AC to be run, the time limit 
to be placed on the running AC to prevent waste if the AC 



79 



^^^^^^ s^^m^'^wm^^^^^^^y^-^ >r r? r ~ > > -r-*^ r ^ p 



develops problems while the user Is not present, and 
perhaps the user may wish to give a date and time before 
which his AC should not be run (useful if It is known that 
data needed by the AC will not be available until that time). 

The CREATE-ABS command is provided for users to create 
AC's. CBEATE-ABS may be used by an IC or an AC belonging to 
the user creating the new AC. Since the computation must 
already be logged in there is no Identity validation necessary. 
CBEATE-ABS results in a call to Load Control which either 
initiates the computation immediately or places it into the 
waiting queue for the specified stream depending upon the 
current system load. 



6.2 Terminating an AC 

Every computation, upon completion must undergo an 
orderly logging out procedure to remove the computation 
from the system and take care of certain "cleawtp" problems. 
In addition, it Is sometimes desirable to be able to bring 
a computation to an early end (such as when the user discovers 
he has left an AC running with bad input data). 

The TEHM-ABS oommand is provided to perTJotm both 
the normal-end and early-end funotions f or AC'S. The user 
specifies the computation-identification of the AC to be 
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terminated. Load Control Is oalled upon to search the 
queueing mechanism to see If the AC is Halting to be run, 
running, or no longer on the system (either it Is done or 
the computation-identlfioation was Incorrect). If the 
AC is waiting to be run then the entry for the AC In the 
waiting queue is deleted. If the AC is currently running 
then it is stopped immediately and logged out, If the 
AC is not on the system then the user is so informed. 



6,3 Changing the Stream (Priority) of an AC 

When the system is heavily loaded the user may find 
that his AC»s take longer to run $o completion. To speed 
up the processing the user may wish to place the AC into 
a higher priority stream (for which he may be oharged more 
but will get better service). 

The CHANGE-STREAK command is provided to remove an 
AC from one stream and place it into another. The user 
specifies the computation-identification of his IC, the 
stream it is currently in, and the stream into whloh it is 
to be placed. Note that the CHANGE-STREAM command is also 
useful for switching IC»s from one interactive stream to 
another. 
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A user nay wish, to run a large computation as absentee 
but in order to be sure that he has set the computation up 
properly he nay want to run It interactively for a while. 
Once the computation gets going successfully (perhaps the 
user notes that the proper output is being generated) then the 
user may convert this running computation to absentee* 

The CONVERT command is provided to enable a user to 
switch a running IC to an AC. The user first presses the 
"QUIT" button at his terminal to stop the computation so 
that the CONVERT command may be typed. 



6.5 Conyw r^Vy; # fl AC to an IC 

The user may wish to monitor the progress of one 
of his AG's for a while to make sure that It Is running 
smoothly, or perhaps to user would like to make some ohanges 
in the absentee source file or other data supplied to the 
AC. 

The CAPTURE command is provided to allow the user to 
capture oontrol of one of his AC 'a so that it can be controlled 
from the user's terminal. Note that the user may wish to 
finish the computation interactively or he may wish to issue 
a CONVERT command to allow the computation to finish as absentee. 
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Note that by using CAPTURE and CONVERT the user may 
actually control several computations at one time from a 
single terminal/ This Is particularly convenient for 
computations which may need only minor intervention. 



6,6 Obtaining Status Information for a User's Computations 
a user may .'.-hare many computations running at one time 
and may have many absentee computation* in the waiting queues 
waiting to be run. The user may want to monitor the progress 
of these computations and find out if it might be necessary 
to intervene (via CAPTURE and CONVERT) with some of them 
to correct any error Conditions which might exist. Also 
the user may find that some computations are running too 
slowly and thus it may be desirable to issue a CHANGE-STREAM 
command. 

The STATUS command is provided to give the user 
Information about his various computations on the system. 
STATUS may be used either to find out about a specific 
computation, a group of computations, or about all of this 
user*s computations. Information is returned to the user 
indicating how much time each computation has used, what 
dedicated resources are being used by each computation, when 
each computation was initiated, etc. 
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6.7 Reouestlng Intervention by an IC 

Normally, if an AC develops problems while it is 
running it cannot be run to completion because it needs 
information which is unavailable to it in the absence 
of its owner. However, if a user who submits an AC happens 
to also be running interactively when such trouble occurs 
then it is possible that the user will be able to supply 
the necessary information (or corrections) to the AC so 
that it may run to completion. 

The INTERVENE command is provided to aid an interactive 
user in specifying that he is available to aid his AC* s if 
trouble develops. Sometimes.. the nature of the interactive 
user* s work would make it undesirable to be interrupted by 
a call for help by an AC. and in such a case INTERVENE would 
not be issued by the IC. An interactive user uses CAPTURE 
and CONVERT to effect an intervention. 



6.8 Specifying the AC-IC Load Apportionment 

The System Administrator must specify the apportionment 
of system computing power between the various computation 
streams on the system. 

The LOAD-SPEC command is provided to allow the 
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System Administrator to make a loagL apportionment or 

reapportionment. The initial load apportionment is 

performed at system startup time and reapportionments 

may be done whenever necessary. If for a particular 

application the apportionments should be the same for 

certain regular periods (shifts) then the System Administrator 

may specify apportionments for each of these shifts and 

Load Control will keep these available. Whenever the 

time for a new shift arises then Load Control will dynamically 

reapportion the system in the manner discussed In 

Chapter 5 t 



6.9 Other ConimitnrtB for Administrative Personnel 

Administrative personnel may find the STATUS and 
TEBM-ABS commands useful* STATUS may be used to obtain 
status information for any computation on the entire system 
and TERM-ABS may be used to terminate an AC which 
appears to be causing problems (such as tying up certain 
resources). 
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CHAPTER 7 
Summary 



The work described in this thesis was concentrated in 
two areas i a general discussion about the- characteristics 
6f absentee computations, and the design Of a mechanism for 
handling absentee computations in a multiple-access computer 
system. 

Perhaps the most significant contributions of the 
thesis are the concepts of shelving and unshelving absentee 
computations, the concepts of absentee and interactive 
computation streams, the design of the multiple-stream 
queueing mechanism, and the design of the load oontrol 
mechanism for hybrid multiple-stream interaetlve/absentee 
systems. 

The design of the combined queueing and load control 
mechanisms has the following significant characteristics! 

1 - The System Administrator may apportion the computing 
capability of the system between Interactive and 
absentee computations in any proportion whatever. 
This allows the system to be lOOjf interactive, 
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lOOJf absentee, or any intermediate combination 
of the two modes. 

2 - The computation stream concept allows computations 

of different "types* to run in different streams. 
One such differentiation might b*' a priority scheme 
in which eaoh stream contains all the computations 
of a particular priority. 

3 - Absentee streams have the property that running 

computations may be temporarily suspended and 

restarted ( shelved and unahelved) several times 

as they flow through the stream. This property 

is one of the keys to the suecess of the load control 

mechanism. 

k - The multiple-stream meohanlsm has the property that 
the load in each stream is individually controlled. 

5 - The multiple-stream mechanism maintains a precise 
ordering among all computations whether they be 
interactive or absentee and waiting or running. 
For example, In a priority scheme the computation 
streams are ordered by their respective priorities. 
Within each Computation stream waiting computations 
are ordered by virtue of their position within the 
waiting queue (f irst-ln-first-out discipline is 
used in this work for choosing the next entry), and 
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running confutations -are; ordered by virtue 
of their position within the running queue (last-in- 
flrst-out -discipline is used in this work). 
Thus, if at any time the load control mechanism 
wishes to eliminate or initiate a computation, the 
choice of which computation to eliminate or which 
to initiate is determined by the ordering described 
above* Thus the load control mechanism is made 
more efficient than It would be If the above choice 
was ndt always predetermined. 
6 - The load control mechanism prevents waste of available 
computation slots by allowing streams to become 
overloaded if slots in other streams are unused, 
at the same time* the mechanism insures computations 
in a particular stream first claim to slots which 
have been specifically allocated to that stream. 
Thus stream 1 can become over-loaded by using 
available slots in stream J. However, If the 
demand builds up again in J, then the over-load 
stream i computation must relinquish the usurped 
slot and Is either shelved if it is absentee or is 
logged out if it is Interactive, 
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7 - Finally, the load control mechanism 
effects load reapportionments Quickly 
and smoothly. If a computation running 
before the reapportionment should also 
run after the reapportionment, load control 
carefully avoids either shelving or logging 
but the (Computation* Initiation of malting 
computations and elimination of running 
computations is done quickly because the ordering 
described in (5) above makes the selection 
such computations trivial. 
It is worthwhile to note here that there are two obvious 
levels at which load control decisions can be mads, namely 
the admission level and the scheduling level. At the admission 
level decisions are made regarding which AC* a and IC's shall 
be allowed to log in to the system. At the scheduling level 
decisions are made regarding which of the logged in AC*s and 
IC's shall be the next to be given a processor when one 
becomes available. The mechanism designed in this work 
operates at the admission level only. Once this load 
control mechanism allows a computation to log into the 
system, the computation must then fend for itself in the 
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competition for processors. At this higher level decisions 
must be made on the basis of less specific information and 
must be intended to be enforced over longer periods of time. 
The apportionment we speak of would probably be in force 
for at least several hours at a time, and the load control 
mechanism we propose might be reasonably certain to assure 
that actual usage closely approximates the apportionment 
in the average over such a long period. 

Recalling the simplifying assumptions made in Chapter 
5, namely that each slot is the same size regardless of the 
particular traits of the computation using the slot, we see 
that perhaps it would be useful to have our load control 
mechanism receive information ?rem the scheduling' level v Such 
information combined with an atomic-slot mechanism as 
discussed in Chapter 5 would help to provide much more 
precise oontrol over the system load than the mechanism 
proposed In this work. The design of such a mechanism is 
suggested for those interested in pursuing research In 
this area. 
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